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The relevance of a phenomenon arising in a game often hinges upon this 
phenomenon being robust to perturbation of the payoffs of the game. To 
establish such robustness results typically requires proving that some of the 
properties of the game we initially considered are themselves robust; that 
is, that the set of games having these properties is open. We investigate 
here whether the set of finite normal-form games with a unique equilibrium 
is open, for Nash equilibrium, correlated equilibrium, and variants of Nash 
equilibrium such as symmetric Nash equilibrium in symmetric games. 

For Nash equilibrium in two-player games, the question has been solved by 
Jansen (1981), who showed that the set of bimatrix games with a unique Nash 
equilibrium is open. However, this result does not extend to three-player 
games nor to symmetric equilibria of symmetric bimatrix games: counterex- 
amples are given in section [HI Our main result is that, by contrast, for any 
number of players n, the set of n-player finite games with a unique correlated 
equilibrium is open. This generalizes an earlier result of Noa Nitzan (2005). 

An intuitive explanation of the discrepancy between the results on Nash 
equilibrium and those on correlated equilibrium is as follows: the proof of the 
openness of the set of bimatrix games with a unique Nash equilibrium uses 
three ingredients : upper-semi-continuity of the equilibrium correspondence, 
an element of linearity in the structure of the set of equilibria (the set of 
Nash equilibria of a bimatrix game is a finite union of convex polytopes) and 
the fact that in bimatrix games, a unique Nash equilibrium is quasi-strict 
(Jansen, 1981); that is, for each player, no pure best response to the strategy 
of the other player is outside the support of her own strategy. 

For Nash equilibrium, the last two ingredients are specific to two-player 
games, and the last one is also lacking for symmetric Nash equilibria of sym- 
metric bimatrix games. This accounts for our negative results. By contrast, 
for any number of players, there is strong element of linearity in the struc- 
ture of the set of correlated equilibria (this is a polytope). Furthermore, and 
this is the crucial lemma, it may be shown that for any number of players, 
a unique correlated equilibrium is a quasi-strict Nash equilibrium. This fol- 
lows from the strong complementary property of linear programs and dual 
reduction arguments (Myerson, 1997). 

The material is organized as follows: Definitions and notations are intro- 
duced in section 1. Openness of the set of games with a unique correlated 
equilibrium is proved in section 2. Section [3J groups remarks and related 
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results: We first show that generic zero-sum games have a unique correlated 
equilibrium and discuss the connections of our work with Nitzan's (2005). It 
is then shown that the set of 3-player games with a unique Nash equilibrium 
and the set of symmetric bimatrix games with a unique symmetric Nash 
equilibrium are not open, but that the set of symmetric bimatrix games with 
a unique and quasi-strict symmetric Nash equilibrium is. It is also shown 
that for any n, k > 2, the set of n-player games with k Nash equilibria (or k 
extreme points to the set of correlated equilibria) is not open, though for al- 
most every game G, every game in a neighborhood of G has the same number 
of equilibria as G. We then study the structure of the set of Nash equilib- 
ria for bimatrix games at the relative boundary of the set of games with a 
unique correlated equilibrium. Finally, we show that the set of two-player 
zero-sum games in which one of the players has a unique optimal strategy is 
not open. This explains that the openness of the set of games with a unique 
correlated equilibrium cannot be deduced easily from Hart and Schmeidler's 
(1989) proof of existence of correlated equilibria. 

1 Definitions and main result 

Let G be a finite n-player game. I = {1, 2, n} is the set of players, S l the 
set of pure strategies of player i and S^" 1 := Xjfzj^yS^ . The utility function 
of player i is U l : S = x^iS 1 — > R. As usual, U l is extended multilinearly to 
the set of probability distributions over S. A pure strategy profile is denoted 
by s = (s*,s~ l ) and a mixed strategy profile by a = (a\a~ l ). The support 
of a 1 is denoted by 

Supp{a l ) := {s l G S l : a l {s l ) > 0} 

and the set of pure best-responses to <j~ 1 by 

PBR{a- 1 ) := {s l G S\W G S\ U\s\ a' 1 ) > U\t\(j- 1 )} 

Finally, for any finite set T, the simplex of probability distributions over T 
is denoted by A(T). 

A correlated strategy of the players in / is a probability distribution over 
the set S of pure strategy profiles. Thus u = (u(s)) sG s' is a correlated strategy 
if: 

u(s) > \/seS (1) 
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5>(s) = l (2) 

Henceforth, the conditions in (CQ) will be called nonnegativity constraints. For 
s\ f in S' 1 and fi in A(S), let 

h**0M):= J2 Ks)iU%s)-U*(t\s-*)] 

8- i e£i'- < 

where, as throughout, s = (s\ s - *). 

Definition. A correlated strategy fi is a correlated equilibrium (Aumann, 
1974) if it satisfies the following incentive constraints: 

(//) > 0, Vz G /, Vs l e S*, Vf G (3) 

Since conditions (CQ), (j2J) and ([31) are all linear in /x, it follows that the set of 
correlated equilibria of any finite game is a polytope. 

A n-player finite game has size mi x m-i x ... x m n if, for every i in /, the 
pure strategy set of player i has cardinal m 8 . Assimilating a game and its 
payoff matrices, a n-player game of size mi x m 2 x ... x m n may be seen as 
a point in (f m i m 2- m ») n ) hence the notions of a neighborhood of a game and 
of an open set of games. The main result of this paper is that: 

Proposition 1. The set of n-player games of size mi x m 2 x ... x m n with 
a unique correlated equilibrium is an open subset of the set of games of size 
mi x m2 x .... x m n . Furthermore, if a n-player finite game has a unique 
correlated equilibrium o, then the (unique) correlated equilibrium of every 
nearby game has the same support as a. 

2 Proof 

Let G be a game with a unique correlated equilibrium and (G n ) a sequence 
of games converging towards G. We need to show that, for n large enough, 
the game G n has a unique correlated equilibrium. The proof runs as follows: 
Let a denote the unique correlated equilibrium of G. A dual reduction ar- 
gument shows that a is a quasi-strict Nash equilibrium (lemma [S])- Together 
with the upper semi-continuity of the Nash equilibrium correspondence this 
implies that, for n large enough, G n has a quasi-strict Nash equilibrium with 
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the same support as a (lemma E]). Since two quasi-strict Nash equilibria with 
the same support satisfy the same nonnegativity and incentive constraints 
with equality (lemma [6]), it follows that, for n large enough, G n has a cor- 
related equilibrium satisfying with equality the same constraints as a. Due 
to a general result on polytopes (lemma [2]), this implies that, for n suffi- 
ciently large, the correlated equilibrium polytope of G n is a singleton. This 
completes the proof. 

We begin with the result on polytopes: Let (A n ) be a sequence of p x q 
real matrices, (b n ) a sequence of column vectors of size p, and J = {1, ...,p}. 
Let 

C n = {xG R q , A n x > b n } 

(A n x > b n means that the weak inequality holds for each coordinate). Make 
the following assumptions: first, C n is uniformly bounded: 

3M G R, Wi G N, Vx G C n , max | ( A n x) | < M (4) 

In particular, C n is a polytope. Second, (A n ) and (b n ) converge respectively 
towards the matrix A and the vector b. Third, the "limit polytope" 

C = {x G R Q , Ax > b} 

is a singleton: C = {x}. Let J' := {j G J, (Ax) 3 - = 6j} denote the set of 
constraints binding at x, and let J" = J\J'. Finally, let b n j denote the ] th 
component of b n . 

Lemma 2. If there exists N G N such that, for all n > N, there exists Xn in 
C n with 

Vj G J', (A n x n )j = b nJ (5) 
then for n large enough, C n is a singleton. 

Proof. We begin by showing that, for n large enough, all constraints satisfied 
with strict inequality by x are satisfied with strict inequality by every x in 
C n '. 

3N' G N, Vn > N', Vx G C n , Vj G J" , (A n x) i > 6 nj - (6) 

For all n in iV, let z n G C n . To establish ([6]), it suffices to show that for n 
large enough, 

Vj G J", (A n z„)j > b n j (7) 
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Due to (jlj), the sequence (z n ) is bounded. Furthermore, since A n — > A and 
b n — > b, any accumulation point z of (z n ) satisfies z e C, hence z = x. It 
follows that (z„) converges to x. Therefore A n z n — b„ converges to Ax — b. 
Since (Ax)j — hj > for every j in J", it follows that, for n large enough, 
(J7J) is satisfied. This completes the proof of (EJ). 

We now prove the lemma: let n > max(N,N') and let x n satisfy (151). 
If C n is not a singleton, then C n has an extreme point z n ^ x n . By basic 
properties of extreme points, one of the constraints defining C n is binding at 
z n but not at x„. Since (A n x n )j = 5 nj - for all j in J', this implies that there 
exists j in J" such that (A n z n )j = b n j. This contradicts (J6j). Therefore C n 
is a singleton. □ 

Lemma 3. // an n-player finite game has a unique correlated equilibrium a 
then this correlated equilibrium is a quasi-strict Nash equilibrium. 

Proof. The fact that a is a Nash equilibrium follows from the existence of 
Nash equilibria and the fact that Nash equilibria are correlated equilibria. 
What we really need to show is that a is quasi-strict. 

For each player i in /, let a 1 be a transition probability over the set of 
pure strategies of player i: 

a 1 : S i -> A{S l ) 
s l — > a 1 * s l 

A mixed strategy t % of player i is a 1 -invariant if a 1 * r l = t % where the 
mixed strategy a % * r % is defined by 

[a* * T { ] (?) = T ^ si ) (\ ai * si ] Vti G Si 

s i es i 

It follows from (Nau and McCardle, 1990, last paragraph of section 2 and 
proposition 2) that there exists a vector of transition probabilities a such 
that, for every pure strategy profile s in S, 

-U^s)] > (8) 

with strict inequality if s has probability zero in all correlated equilibria. Fix 
such a vector a = (a 1 )^. We claim that: 

Claim 4. For every i in I, the mixed strategy a 1 is a 1 -invariant. 
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This will be proved in the end. Assume that the pure strategy s % does not 
belong to the support of o % and let r = (s l ,cr _i ). Since o is the unique 
correlated equilibrium of G, it follows that every pure strategy profile s in 
the support of r has probability zero in all correlated equilibria. Therefore, 
by definition of a, 

T (s) > P 7 *^* * s *» s ' k ) ~ Uk ( s )] > 

kei 

It follows that 

[U k (a k * t\ r~ k ) - U k (r)] = T ( s ) P 7 ^ * * s *' s ~*) ~ > 

kei seS kei 

(9) 

(to prove the equality, use U k (a k * r k , r~ k ) = J2s k es k T k (s k )U k (a k * s k ,r _fc )). 
For every k ^ i, r k = o k hence, by claim @J r k is a fc -invariant. Therefore, 
(ED boils down to U\a l * r\ r^) > U\r)] that is, 

U i {aUs i ,cr- i ) > 

This implies that s l is not a best-response to a~ l . Since s l was an arbitrary 
strategy not in the support of a\ it follows that a is quasi-strict. 

It only remains to prove claim HI The proof is based on dual reduction 
(Myerson, 1997). Fix a as above. Note that, due to (jHJ), « is a dual vector in 
the sense of Myerson (1997). Define the a-reduced game G/a as in (Myerson, 
1997). That is, in G/a, the set of players and the payoffs are as in G, but 
the mixed strategies available to player i are only those mixed strategies a 1 
of player i in G that are a l -invariant. Myerson (1997) shows that G/a is a 
finite game, hence it has a Nash equilibrium. Let a be a Nash equilibrium of 
G/a. By definition of G/a, we may see a as a mixed strategy profile of G, 
with b % a*-invariant. Since a is a Nash equilibrium of G/a, it follows from 
theorem 1 of Myerson (1997) that a is a Nash equilibrium of G. Therefore 
a = a. Since a % is a l -invariant, this implies that a % is a*-invariant too. This 
completes the proof. □ 

The following lemma is a version of lemma 4.1 of Jansen (1981). 

Lemma 5. If the n-player game G has a unique Nash equilibrium o and this 
Nash equilibrium is quasi-strict, then there exists a neighbourhood of G 
such that, for every game G in an d every Nash equilibrium a of G, the 
support of a is equal to the support of a and a is quasi-strict. 
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Proof. Let (G n ) n£ ^ be a sequence of games converging to G and a n a Nash 
equilibrium of G n . To prove lemma El it is enough to show that, for n large 
enough, the support of a n is equal to the support of a and a n is quasi- 
strict. Since the Nash equilibrium correspondence is upper semi-continuous 
and since G has a unique Nash equilibrium, it follows that a n converges to 
a. Therefore, 

3N GN,Vn> N, Vz' G /, Suppip*) C Supp{a i n ) (10) 

Furthermore, if U l {s 1 , a~ l ) < U l (a) then for n large enough, U^(s\ a~ l ) < 
Un(a n ), where U l n denotes the utility function of player z in the game G n . 
Therefore, 

3N' G N,Vn > N', Vz G /, PBR(o-- 1 ) C PBR{a~ l ) (11) 

Finally, since the Nash equilibrium cr is quasi-strict, it follows that PBR(a~ l ) = 
Supp(o~~ l ) . Together with ffTUj) and (jlip . this implies that for n large enough: 

Supp{ai) C PBR(a~ i ) C PBR(a^ i ) = Supp{a l ) C Supp{a i n ) 

Since the beginning and the end of this chain of inclusion are equal, this is 
a chain of equality In particular, Supp(a l n ) = PBR(o~~ l ) = Supp(a l ). The 
result follows. □ 

Lemma 6. Let G and (5 6e two games with the same set of players and 
strategies. Let a and a be Nash equilibria of, respectively, G and G. Assume 
that a and a have the same support and are both quasi-strict. Then, among 
the nonnegativity and incentive constraints defining correlated equilibria, a 
and a satisfy the same constraints with equality. 

Proof. Since, by assumption, o and a have the same support, the nonnega- 
tivity constraints they satisfy with equality are the same. We now show that 
the incentive constraints they satisfy with equality are also the same. Since 
cr is a product distribution, it follows that 

= a *( 8 i) [U\s\a- 1 ) - a - *)] Vi,Vs\Vf 

Let S = XiS 1 denote the support of both a and a. If s l £ S\ then a % (s l ) = 
hence h sl,t \o~) = for every t % in S % . If s % G S l and t % G S*\ then, since a is 
a Nash equilibrium, U l (s\ a~ % ) = U l (t l , a~ l ) hence h sl ' tl (o) = 0. Finally, if 
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s l G S l and f ^ 5** then c l (s l ) > and, since a is quasi-strict, U % (s l , c~ l ) — 
U l (t l ,<j~ t ) > 0. Therefore, h s ' ,l \a) > 0. Grouping these observations we 
obtain that h s%,t {a) > if and only if s l G S" 1 and t l ^ S l . The same result 
holds for a so that, letting {h sl ' t ') s i £ s i ,t i €S i denote the linear forms associated 
with the correlated equilibrium incentive constraints of G, we have: 

h"' = 0^h st ' t '(a) = 

This completes the proof. □ 

We now conclude. Let G be a game with a unique correlated equilibrium 
cr and (G n ) be a sequence of games converging towards G. Let C n be the 
correlated equilibrium polytope of G n . Combining lemmas [3J [5] and El we 
obtain that, for n large enough, G n has a correlated equilibrium a n satisfying 
with equality the same constraints as cr. By lemma [2} this implies that for n 
large enough, C n is a singleton. This completes the proof of proposition [TJ 

3 Remarks and related results 

1. The fact that the set of mi x m% x ... x m n games with a unique 
correlated equilibrium is nonempty is obvious: any dominance solvable game 
has a unique correlated equilibrium. Note also that generic two-player zero- 
sum games have a unique correlated equilibrium. This follows from the 
observation that: (i) a zero-sum game has a unique correlated equilibrium 
if and only if it has a unique Nash equilibrium (Forges, 1990); (ii) generic 
zero-sum games have a unique Nash equilibrium (Bohnenblust et al, 1950). 

2. Nitzan (2005) proved independently and earlier a weaker version of 
proposition [U More precisely, she proved that if a two-player m x m game 
has a unique correlated equilibrium and that this correlated equilibrium has 
full support, then every nearby game has a unique correlated equilibrium 
and this correlated equilibrium has full support. To prove this result with 
our method, it suffices to note that if a game has a unique and completely 
mixed Nash equilibrium, then every nearby game has a completely mixed 
Nash equilibrium, and then to apply lemma [21 This illustrates a difference 
between our arguments and Nitzan's: while she uses a theorem of the alter- 
native, we do not need any theorem of the alternative to prove her results. 
(We do however use a theorem of the alternative to prove proposition [TJ In- 
deed, the proof of lemma [3] uses Nau and McCardle's (1990) characterization 
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of strategy profiles with positive probability in at least one correlated equi- 
librium, which itself relies on a theorem of the alternative.) 

3. The set of 3-player games with a unique Nash equilibrium is not open. 
The following 2x2x2 counter-example is adapted from (Flesch et al, 1997) 
and was provided by Eilon Solan (personal communication). 

1,1,1 0,1,1 \ / 1,0,1-e 1,1,0 \ 
1,1,0 1,0,1 J \ 0,1,1 0,0,0 ) 1 ] 

Player 1 chooses a row (Top or Bottom), player 2 a column (Left or Right) 
and player 3 a matrix (West or East). For e = 0, there is a unique Nash 
equilibrium, in which all players play their first strategy (this will be proved 
below). However, for e > 0, there is a continuum of Nash equilibria. Indeed, 
every (partially) mixed strategy profile in which player 1 plays Bottom with 
probability less than e/(l + e) and player 2 and 3 stick to their first strategy 
is a Nash equilibrium. Thus, in 3-player games, there are sequences of games 
with a continuum of Nash equilibria converging towards a game with a unique 
Nash equilibrium. 

The game (1T2"]) with e = also provides an example of a game with a 
unique Nash equilibrium that is not quasi-strict. This calls for two remarks: 
first, while it is well known that 3-player games need not have a quasi- strict 
equilibrium, the counter-examples I found in the literature, e.g. (Raghavan, 
2002), are of games with several Nash equilibria. Thus, up to my knowl- 
edge, whether a unique Nash equilibrium is necessarily quasi-strict was still 
open. Second, in two-player games, a unique Nash equilibrium is necessarily 
quasi-strict, as shown by Jansen (1981), and as also follows from the fact 
that every bimatrix game has a quasi-strict Nash equilibrium (Norde, 1999). 

Proof that the game KTW) with e = has a unique Nash equilibrium: for e = 0, 
the game (fT2l) may be described as follows: player i + 1 (counted modulo 3) 
wants to mismatch player i, except if all players play their first strategy. 
Thus, in a hypothetical equilibrium different from Top-Left- West, if i plays 
in pure strategy, then i + 1 must mismatch i, i + 2 mismatch i + 1 and i + 3 = i 
mismatch i + 2; therefore, i must mismatch itself, a contradiction. It follows 
that the only equilibrium in which one of the players plays in pure strategy 
is Top-Left- West. 
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It remains to show that there are no completely mixed Nash equilib- 
ria. By contradiction, let x E]0, 1[ (resp. y, z) be the probability of Bot- 
tom (resp. Right, East) in a hypothetical completely mixed Nash equi- 
librium. Since player 1 is indifferent between Top and Bottom, we have 

— z) = (1 — y)z + yz = z, hence y > z. Since the game is cyclically 
symmetric, it follows that y > z > x > y, which cannot be. This completes 
the proof. ■ 

4. A corollary of lemma is that: 

Corollary 7. The set of games with a unique and strict Nash equilibrium is 
open. 

Indeed, if a game has a unique and strict Nash equilibrium a, then by 
lemma El every Nash equilibrium of every nearby game has the same support 
as a, hence is equal to cr as a is pure. I do not know whether the set of games 
with a unique and quasi-strict Nash equilibrium is open. 

5. The following example shows that, within the set of two-person sym- 
metric games, the set of games with a unique symmetric Nash equilibrium is 
not open: 



/ 


-e, -e 


1- 





1 





\ 




0,1 


0. 





-1, 


-1 




V 


0,1 


-1, 


-1 


o 





/ 



For e = 0, this game has a unique symmetric Nash equilibrium: Top-Left. 
For e > 0, it has 3 symmetric Nash equilibria: (3^,^,0), (^,0,^), 
3+27' 3+2^)- ^ ms ^ s li n ked to the fact that, for e = 0, the unique 
symmetric Nash equilibrium is not quasi-strict. Indeed, the openness of 
the set of bimatrix games with a unique Nash equilibrium has the following 
analogue for symmetric games: 

Proposition 8. Within the set of two-person symmetric games, the set of 
two-person symmetric games with a unique symmetric Nash equilibrium and 
such that this Nash equilibrium is quasi-strict is open. 

Proof. Let G be a two-person game with a unique symmetric Nash equilib- 
rium, with support S = S 1 x S 2 (To make things clear: there might be other, 
asymmetric Nash equilibria) . Assume that the unique symmetric equilibrium 
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is quasi-strict. It follows from a variant of lemma E] that, within the set of 
two-person symmetric games, there exists a neighborhood Qg of G such that, 
for any game G' in VLq-, any symmetric Nash equilibrium of G' has support 
S and is quasi-strict. 

Fix G' in Qq- Since G' is symmetric, it has a symmetric Nash equilib- 
rium a. To establish proposition [HJ it is enough to show that G' has no 
other symmetric Nash equilibrium. By contradiction, assume that G' has a 
symmetric Nash equilibrium r^tr. For every A in R, define the symmetric 
mixed strategy profile a\ by a\ = \t % + (1 — X)a\ for i = 1,2. 

There are five types of incentive and nonnegativity constraints that <j\ 
must satisfy in order to be a (symmetric) Nash equilibrium: 

(i) ct x (s) >0,seS; 

(ii) °x(s)>0,s(£S; 

(iii) /i sV > A ) > 0,s i G S\f iS\i = 1,2; 

(iv) h s ^ e \a x ) > 0, s l e S\t l e S\ i = 1,2; 

(v) h sl ^(a x ) > 0,s i <£ 6 S\i = 1,2. 

Using the fact that both cr and r are Nash equilibria with support S, it is 
easily checked that for every A in R, er.x satisfies (with equality) all constraints 
of types (ii), (iv) and (v). 

Moreover, since o ^ t and since the set of Nash equilibria is compact, it 
follows that there exists a maximal value of A such that a\ is a (symmetric) 
Nash equilibrium. Call this value A max . Since all symmetric Nash equilibria 
of G' have support S and are quasi-strict, they all satisfy with strict inequal- 
ity all constraints of types (i) and (iii), hence so does a\ max - Therefore, there 
exists A > Xmax such that a\ satisfies all constraints of type (i) and (iii). 
Since, as mentioned in the previous paragraph, a\ also satisfies all other con- 
straints, it follows that a\ is a (symmetric) Nash equilibrium, contradicting 
the maximality of X ma x- D 

Finally, a variant of the proof of corollary [7] shows that the set of n-player 
symmetric games with a unique symmetric Nash equilibrium and such that 
this equilibrium is strict is open. 

6. Until now, we focused on games with a unique equilibrium, but we 
might also ask whether, for k > 2, having k Nash equilibria, or k extreme 
points to the set of correlated equilibria, is a robust property. The answer is 
negative: 
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Proposition 9. For every n, k > 2, the set of n-player games with k (< k, 
> k) Nash equilibria is not open; similarly, the set of n-player games with k 
(< k, > k) extreme points of the set of correlated equilibria is not open. 

We provide a counterexample for the case n = 2, k = 3. The counter- 
example is easily generalized to any numbers n, k > 2. For simplicity, call 
extreme correlated equilibria the extreme points of the set of correlated equi- 
libria. Consider the following game: 
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(13) 



For e = 0, both players can guarantee by playing the third strategy, and 
this is the highest payoff they can get. It follows that in any correlated equi- 
librium, the off-diagonal strategy profiles have probability zero. Therefore, 
the three pure strategy profiles on the diagonal are the only Nash equilibria 
of the game and these are also the extreme correlated equilibria. For e < 0, 
the Nash equilibrium (M, M) disappears, and only two Nash equilibria re- 
main, which again are also the extreme correlated equilibria. For e > 0, there 
are 4 Nash equilibria (resp. 6 extreme correlated equilibria): (T, L) and the 
Nash equilibria (resp. extreme correlated equilibria) of the 2x2 coordination 
game obtained by eliminating the strategies T and L. 

7. The reason why a slight perturbation of the payoffs of (JTBl may alter 
the number of equilibria of the game is that not all equilibria are quasi-strict. 
Indeed, Jansen (1981, lemma 8.3 and remark 8.8) showed that if all equilibria 
of a bimatrix game are quasi-strict, then (i) the game has a finite number of 
equilibria and (ii) every nearby game has the same number of equilibria. 

Using the fact that a finite game has a finite number of equilibrium com- 
ponents and upper-semi-continuity of the Nash equilibrium correspondence, 
it is easy to generalize Jansen's result as follows: if all equilibria of a n-player 
game are strongly stable (in the sense of van Damme, 1991) then (i) and (ii) 
above hold. Since for bimatrix games, all equilibria are strongly stable if and 
only if all equilibria are quasi-strict, this indeed generalizes Jansen's result. 
Furthermore, since for almost all games, all equilibria are strongly stable 
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(see, e.g., van Damme, 1991), it follows that (i) and (ii) hold for almost all 
games. 

Finally, it follows from the above discussion, and it is easy to show di- 
rectly that the set of n-player games with k equilibria, all strict, is open; but 
for k > 2, this set is actually void. Indeed, if a game has k > 2 equilibria, 
all strict, then it follows from an index argument that there exists at least 
k — 1 mixed Nash equilibria, a contradiction. See corollary 2 and theorem 3 
of Ritzberger (1994). 

8. In bimatrix games, both the set of games with a unique Nash equi- 
librium and the set of games with a unique correlated equilibrium are open. 
Since there are games with a unique Nash equilibrium but many correlated 
equilibria, the latter set is included in the former. The following examples 
show that on the relative boundary of the set of bimatrix games with a unique 
correlated equilibrium, there are games with a continuum of Nash equilib- 
ria, games with a finite number (> 1) of Nash equilibria, and games with a 
unique Nash equilibrium: 

/ 0,0 2,1 1,2 -l,x \ 
1,2 0,0 2,1 -l,x 
2,1 1,2 0,0 -l,x 
\ x, -1 x, -1 x, -1 0, J 

The left game is a one-person game. For e > it has a unique correlated 
equilibrium. For e = it has a continuum of Nash equilibria. The middle 
game has a unique correlated equilibrium (Top- Left) for e > 0, but two Nash 
equilibria for e = 0. The game on the right is adapted from (Nau and Mc- 
Cardle, 1990, example 4). The 3x3 game in the top-left corner is due to 
Moulin and Vial (1978). This 3x3 game has a unique Nash equilibrium: 
(1/3,1/3,1/3) for both players, with payoff 1; but putting probability 1/6 
on every off-diagonal square yields a correlated equilibrium with payoff 3/2. 
Now consider the whole 4x4 game. For any value of x, (4,4) is a Nash equi- 
librium. For 1 < x < 3/2, this is the unique Nash equilibrium, but not the 
unique correlated equilibrium (the correlated equilibrium with payoff 3/2 of 
the 3x3 top-left game induces a correlated equilibrium of the whole game). 
For x > 3/2, this is the unique correlated equilibrium. 




1,1 0,0 
0,0 -e, - 
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9. In order to prove the existence of correlated equilibria without using 
a fixed point theorem, Hart and Schmeidler (1989) associate to every finite 
game G an auxiliary zero-sum game whose size depends only on the size of 
G and whose payoff matrix depends continuously on the payoff matrices of 
G. In this auxiliary zero-sum game, the optimal strategies of the maximizer 
correspond exactly to the correlated equilibria of G, so that G has a unique 
correlated equilibrium if and only if, in the auxiliary game, the maximizer 
has a unique optimal strategy. Therefore, to prove the openness of the set 
of games with a unique correlated equilibrium, it would have been enough 
to show that: If in a two-player zero-sum game, one of the players has a 
unique optimal strategy, then in every nearby zero-sum game this player has 
a unique optimal strategy. 

However, this turns out to be false: let G t be the two-player zero-sum 
game with payoff matrix for the row player 
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R 
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— e 
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M 







-1 
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V 





-1 


/ 



For e = 0, the row player has a unique optimal strategy (playing T). But for 
e > 0, the row player has an infinite number of optimal strategies: playing 
T with probability 1/(1 + e) and playing M and B with any probabilities 
summing to e/(l + e). 
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